As ML models have increased in capabilities and accuracy, so has the complexity of their deployments. Increasingly, ML model consumers are turning to service providers to serve the ML models in the ML-as-a-service (MLaaS) paradigm. As MLaaS proliferates, a critical requirement emerges: how can model consumers verify that the correct predictions were served, in the face of malicious, lazy, or buggy service providers? In this work, we present the first practical ImageNet-scale method to verify ML model inference non-interactively, i.e., after the inference has been done. To do so, we leverage recent developments in ZK-SNARKs (zero-knowledge succinct non-interactive argument of knowledge), a form of zero-knowledge proofs. ZK-SNARKs allows us to verify ML model execution non-interactively and with only standard cryptographic hardness assumptions. In particular, we provide the first ZK-SNARK proof of valid inference for a full resolution ImageNet model, achieving 79\% top-5 accuracy. We further use these ZK-SNARKs to design protocols to verify ML model execution in a variety of scenarios, including for verifying MLaaS predictions, verifying MLaaS model accuracy, and using ML models for trustless retrieval. Together, our results show that ZK-SNARKs have the promise to make verified ML model inference practical.

Turkey is about to add a new addition to its high technology investments and projects in order to increase efficiency in preventing smuggling and reducing formalities at customs. A total of 68 X-Ray Vehicle and Container Scanning systems, which provide detailed analysis of all kinds of vehicles and containers entering and exiting from customs gates without requiring physical intervention, were installed in all customs gates and ports with high trade volume, Trade Minister Ruhsar Pekcan said. "The Scanning Network Project will be completely developed with our local and national resources and will automatically identify illegal crime and threat elements in vehicle or cargo by using artificial intelligence (AI) technologies," Pekcan told Anadolu Agency (AA) in an interview yesterday. These high-tech systems provide x-ray film of vehicles and containers and ensure that customs controls, which can last for hours, take place quickly and in a qualified way within minutes, she said. She stressed that the ministry has established technical infrastructure to carry out customs controls in a manner that does not break the pace of international trade and to combat illegal trade in the most effective way by keeping public health and safety at the forefront.